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Abstract 

Coalition formation is a key topic in multiagent sys- 
tems. One would prefer a coalition structure that max- 
imizes the sum of the values of the coalitions, but often 
the number of coalition structures is too large to allow 
exhaustive search for the optimal one. But then, can 
the coalition structure found via a partial search be 
guaranteed to be within a bound from optimum? 
We show that none of the previous coalition structure 
generation algorithms can establish any bound because 
they search fewer nodes than a threshold that we show 
necessary for establishing a bound. We present an al- 
gorithm that establishes a tight bound within this min- 
imal amount of search, and show that any other algo- 
rithm would have to search strictly more. The fraction 
of nodes needed to be searched approaches zero as the 
number of agents grows. 

If additional time remains, our anytime algorithm 
searches further, and establishes a progressively lower 
tight bound. Surprisingly, just searching one more 
node drops the bound in half. As desired, our algo- 
rithm lowers the bound rapidly early on, and exhibits 
diminishing returns to computation. It also drasti- 
cally outperforms its obvious contenders. Finally, we 
show how to distribute the desired search across self- 
interested manipulative agents. 

Introduction 

Multiagent systems with self-interested agents are be- 
coming increasingly important. One reason for this 
is the technology push of a growing standardized com- 
munication infrastructure — Internet, WWW, Nil, EDI, 
KQML, FIPA, Concordia, Voyager, Odyssey, Tele- 
script, Java, etc — over which separately designed agents 
belonging to different organizations can interact in an 
open environ ment in real-tim e and safely carry out 
transactions ( Sandholm 1 9 9 7| ) . The second reason is 
strong application pull for computer support for negoti- 
ation at the operative decision making level. For exam- 
ple, we are witnessing the advent of small transaction 
commerce on the Internet for purchasing goods, infor- 
mation, and communication bandwidth. There is also 
an industrial trend toward virtual enterprises: dynamic 
alliances of small, agile enterprises which together can 
take advantage of economies of scale when available 
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(e.g., respond to more diverse orders than individual 
agents can), but do not suffer from diseconomies of 
scale. 

Multiagent technology facilitates the automated for- 
mation of such dynamic coalitions at the operative deci- 
sion making level. This automation can save labor time 
of human negotiators, but in addition, other savings are 
possible because computational agents can be more ef- 
fective at finding beneficial short-term coalitions than 
humans are in strategically and combinatorially com- 
plex settings. 

This paper discusses coalition structure generation in 
settings where there are too many coalition structures 
to enumerate and evaluate due to, for example, costly 
or bounded computation and/or limited time. Instead, 
agents have to select a subset of coalition structures on 
which to focus their search. We study which subset 
the agents should focus on so that they are guaranteed 
to reach a coalition structure that has quality within a 
bound from the quality of the optimal coalition struc- 
ture. 

Coalition formation setting 

In many domains, self-interested real world parties — 
e.g., companies or individual people — can save costs by 
coordinating their activities with other parties. For ex- 
ample, when the planning activities are automated, it 
can be useful to automate the coordination activities as 
well. This can be done via a negotiating software agent 
representing each party. Coalition formation includes 
three activities: 

1. Coalition structure generation: formation of coali- 
tions by the agents such that agents within each coali- 
tion coordinate their activities, but agents do not co- 
ordinate between coalitions. Precisely, this means 
partitioning the set of agents into exhaustive and dis- 
joint coalitions. This partition is called a coalition 
structure (CS). 

2. Solving the optimization problem of each coalition. 
This means pooling the tasks and resources of the 
agents in the coalition, and solving this joint prob- 
lem. The coalition's objective is to maximize mone- 
tary value: money received from outside the system 
for accomplishing tasks minus the cost of using re- 
sources. 

3. Dividing the value of the generated solution among 
agents. 



These activities interact. For example, the coalition 
that an agent wants to join depends on the portion of 
the value that the agent would be allocated in each 
potential coalition. 

This paper focuses on settings were the coalition 
structure generation activity is resource-bounded: not 
all coalition structures can be enumerated. 

Our model of coalition structure 
generation 

Let A be the s et of agents, and a — \A\. As is com 



mo n practice ( Kahan fc Rapoport 1984 j_ Shehory fc 
Kra hs 19951 ; I Shchory fc Kraus 1996|; [Zlotkin fe Rosen 
sch 4n 1994 |Ketchpel 1994| ; fjandholm fc Lesser 1997| ) 
we study coalition formation in characteristic function 
games (CFGs). In such games, the value of each coali- 
tion S is given by a characteristic function fs-EQ We as- 
sume that vs is bounded from below for each coalition 
S, i.e. no coalition's value is infinitely negative. We 
normalize the coalition values by subtracting at least 
minscA vs from all coalition values This rescales 
the coalition values so that vs > for all coalitions 
S. This rescaled game is strategically equivalent to the 
original game. 

A coalition structure CS is a partition of agents, A, 
into coalitions. Each agent belongs to exactly one coali- 
tion. Some agents may be alone in their coalitions. We 
will call the set of all coalition structures M . For exam- 
ple, in a game with three agents, there are 7 possible 



1 These coalition values vs may represent the quality of 
the optimal solution for each coalition's optimization prob- 
lem, or they may represent the best bounded-rational value 
that a coalition can get given limited or costly computa- 



tiona l resources for solving the problem ( Sandholm 1 
1997| ). 



Lessei 



In other words, each coalition's value is independent of 
nonmembers' actions. However, in general the value of a 
coalition may depend on nonmembers' actions due to pos- 
itive and negative externalities (interactions of the agents' 
solutions). Negative externalities between a coalition and 
nonmembers are often caused by shared resources. Once 
nonmembers are using the resource to a certain extent, not 
enough of that resource is available to agents in the coalition 
to carry out the planned solution at the minimum cost. Neg- 
ative externalities can also be caused by conflicting goals. In 
satisfying their goals, nonmembers may actua lly move the 
world further fr om the coalition's goal state(s) ( Rosenschein 
&: Zlotkin f994). Positive externalities are often caused by 



partiall y overlapping goals. — In satisfying thoir goale, non 



members may actually move the world closer to the coa.li- 



tion's goal state(s). From there the coalition can reach its 
goals less expensively than it could have without the actions 
of nonmembers. General settings with possible externalities 
can be modeled as normal form games (NFGs) . CFGs are 
a strict subset of NFGs. However, m any real-world mul- 



tiagent problems happen to be CFGs (Sandholm & Lessei 



1997) 



All of the claims of the paper are valid as long as vs > 
for the coalitions that the algorithm sees: coalitions not seen 
during the search may be arbitrarily bad. 



coalitions: {1}, {2}, {3}, {1,2}, {2,3}, {3,1}, {1,2,3} 
and 5 possible coalition structures: {{1}, {2}, {3}}, 
{{1}, {2,3}}, {{2}, {1,3}}, {{3}, {1,2}}, {{1,2,3}}. 

Usually the goal is to maximize the social welfare of 
the agents A by finding a coalition structure 



CS* = argmax V(CS), 

cseM 



where 



V(CS) = 



sees 



(f) 



(2) 



The problem is that the number of coalition struc- 
tures is large (fl(a a / 2 )), so not all coalition structures 
can be enumerated — unless the number of agents is ex- 
tremely small (below 15 or so in practice) {[] Instead, 
we would like to search through a subset N C M of 
coalition structures, pick the best coalition structure 
we have seen 



CSX 



N 



argmax V(CS), 



(3) 



and be guaranteed that this coalition structure is within 
a bound from optimal, i.e. that 



k > 



V(CS*) 
V(CS* N ) 



(4) 



is finite, and as small as possible. We define n m i n to be 
the smallest size of N that allows us to establish such 
a bound fc. 



A 
a 

s 

CS 
CS* 
M 
m 
N 
n 

rijnin 

cs N 

V{CS) 
k 



The set of agents. 

The number of agents, i.e. \A\. 

Symbol for a coalition. 

Symbol for a coalition structure. 

Welfare maximizing coalition structure. 

The set of all possible coalition structures. 

|M|, total number of coalition structures. 

Coalition structures searched so far. 

\N\. 

Minimum n that guarantees a bound k. 
Welfare maximizing CS among ones seen. 
Value of coalition structure CS. 
Worst case bound on value, see Eq. |l[ 



Table 1: Important symbols used in this paper. 



Lack of prior attention 

Coalition structure generation has not prev iously re- 
ceived much attention. Research has focused ( Kahan & 
Rapoport 1984; Zlotkin & Roscnschein 1994) on super- 
additive games, i.e. games where vsut > vs +i>t f° r au 
disjoint coalitions S,T C A In such games, coalition 



structure generation is trivial because the agents are 
best off by forming the grand coalition where all agents 
operate together. In other words, in such games, {^4} 
is a social welfare maximizing coalition structure. 

4 The exact number of coalition structures is 
S"=i ^( a ' *)' where S(a, i) = iS(a — 1, i) + S(a — 1, i — 1), 
and S(a, a) = S(a, 1) = f . 



Superadditivity means that any pair of coalitions is 
best off by merging into one. Classically it is argued 
that almost all games are superadditive because, at 
worst, the agents in a composite coalition can use solu- 
tions that they had when they were in separate coali- 
tions. 

However, many games are not superadditive because 
there is some cost to the coalition formation process it- 
self. For example, there might be coordination overhead 
like communication costs, or possible anti-trust penal- 
ties. Similarly, solving the optimization problem of a 
composite coalition may be more complex than solv- 
ing the optimization problems of component coalitions. 
Therefore, under costly computation, component coali- 
tions may be better off by not form ing the composite 
coalition ( Sandholm fc Lesser 1997 ). Also, if time is 



limited, the agents may not have time to carry out the 
communications and computations required to coordi- 
nate effectively within a composite coalition, so compo- 
nent coalitions may be more advantageous. 

In games that are not superadditive, some coalitions 
are best off merging while others are not. In such cases, 
the social welfare maximizing coalition structure varies. 
This paper focuses on games that are not superadditive 
(or if they are, this is not known in advance). In such 
settings, coalition structure generation is highly non- 
trivial. 



Theorem 1 To bound k, it suffices to search the lowest 
two levels of the coalition structure graph (Figure 
With this search, the bound k = a, and the number of 
nodes searched is n = 2 a ~ 1 . 

Proof. To establish a bound, v$ of each coalition S 
has to be observed (in some coalition structure). The a- 
agent coalition can be observed by visiting the bottom 
node. The second lowest level has coalition structures 
where exactly one subset of agents has split away from 
the grand coalition. Therefore, we see all subsets at 
this level (except the grand coalition) . It follows that a 
search of the lowest two levels sees all coalitions. 

In general, CS* can include at most a coalitions. 
Therefore, 

V(CS*) < amaxw s < a max V(CS) = aV(CS* N ). 
s cseN 

Now we can set k — a > ^q§* \ ■ 

The number of coalition structures on the lowest level 
is 1. The number of coalitions on the second lowest 
level is 2 a — 2 (all subsets of A, except the empty set 
and the grand coalition). There are two coalitions per 
coalition structure on this level, so there are 7 coali- 
tion structures at the second to lowest level. So, there 



are 1 



ia- 1 



lowest two levels. □ 



coalition structures (nodes) on the 



Search graph for coalition structure 

generation 

Taking an outsider's view, the coalition structure gen- 
eration process can be viewed as search in a coalition 
structure graph, Figure ^. Now, how should such a 
graph be searched if there are too many nodes to search 
it completely? 




Level 
(4) 



Figure 1: Coalition structure graph for a 4-agent game. 
The nodes represent coalition structures. The arcs rep- 
resent mergers of two coalition when followed down- 
ward, and splits of a coalition into two coalitions when 
followed upward. 



Minimal search to establish a bound 

This section discusses how a bound k can be established 
while searching as little of the graph as possible. 



Theorem 2 For the algorithm that searches the two 
lowest levels of the graph, the bound k — a is tight. 

Proof. We construct a worst case via which the bound 
is shown to be tight. Choose vs = 1 for all coalitions S 
of size 1, and vs = for the other coalitions. Now, 
CS* = {{l},{2},..,{a}}, and V(CS*) = a. Then 
CS* N = {{l},{2,...,a}}. Because V{CS* N ) = 1, 

V(CS*) _ a _ „ 

v(cs* N ) ~ i - a - D 

Theorem 3 No other search algorithm (than the one 
that searches the bottom two levels) can establish a 
bound k while searching only n = 2° nodes or fewer. 



Proof. In order to establish a bound k, vs of each 
coalition S must be observed. The node on the bot- 
tom level of the graph must be observed since it is the 
only node where the grand coalition appears. Assume 
that the algorithm omits m nodes on the second level. 
Each of the omitted nodes has CS — {P, Q}. Since 
coalitions P and Q are never again in the same coali- 
tion structure, two extra nodes in the graph have to 
be visited to observe vp and vq. Assume m coalition 
structures {Pi, Qi}, {P 2 , Q2}, • • ■ , {P m , Qm} are omit- 
ted. Since for ^ j, at least one of the following is 
true, Pi n Pj ^9,P t n Qj ^ 0, or Q t n Qj ^ 0, at least 
m + 1 coalition structures must be visited to replace the 

5 This is not unique because all coalition structures where 
one agent has split off from the grand coalition have the 
same value. 



m coalition structure omitted. Therefore, for the algo- 
rithm to establish k, it must search n > 2 a_1 nodes. □ 

So, n m i n = 2 a ~ 1 , and this is uniquely established via 
a search algorithm that visits the lowest two levels of 
the graph (order of these visits does not matter) . 

Positive interpretation 

Interpreted positively, our results (Theorem [l]) show 
that — somewhat unintuitively — a worst case bound 
from optimum can be guaranteed without seeing all 
CSs. Moreover, as the number of agents grows, the 
fraction of coalition structures needed to be searched 
approaches zero, i.e. — > as a — > oo. This is 
because the algorithm needs to see only 2 a_1 coalition 
structures while the total number of coalition structures 
is VL{a a / 2 ). See Figure || 



Number of coalition structures 
Number of coalitions 



Number of agents 

Figure 2: Number of coalition structures, coalitions, and 
coalition structures needed to be searched. We use a 
logarithmic scale on the value axis; otherwise n m i n and 
the number of coalitions would be so small compared 
to the number of coalition structures that their curves 
would be indistinguishable from the category axis. 



Interpretation as an impossibility result 

Interpreted negatively, our results (Theorem ^ show 
that exponentially many (2 a ~ 1 ) coalition structures 
have to be searched before a bound can be estab- 
lished. This may be prohibitively complex if the num- 
ber of agents is large — albeit significantly better than 
attempting to enumerate all coalition structures. 

Viewed as a general impossibility result, Theorem [| 
states that no algorithm for coalition structure gen- 
eration can establish a bound in general characteris- 
tic function games without trying at least 2 a_1 coali- 
tion structures. This sheds light on earlier algorithms. 
Specifically, all prior coalition structure generatio n al- 



gori thms for general c haracteristic fu nction games ( 3he- 
hory & Kraus 1996; Kctchpcl 1994) — which we know 
of — fail to establish such a bound. In other words, the 
coalition structure that they find may be arbitrarily far 
from optimal. 



Lowering the bound with further search 

We have devised the following algorithm that will es- 
tablish a bound in the minimal amount of search, and 
then rapidly reduce the bound further if there is time 
for more search.^] 



Algorithm 1 

COALITION-STRUCTURE-SEARCH-1 

1. Search the bottom two levels of the coalition struc- 
ture graph. 

2. Continue with a breadth-first search from the top of 
the graph as long as there is time left, or until the 
entire graph has been searched (this occurs when this 
breadth-first search completes level 3 of the graph, 
i.e. depth a — 3). 

3. Return the coalition structure that has the highest 
welfare among those seen so far. 



In the rest of this section, we analyze how this algo- 
rithm reduces the worst case bound, k, as more of the 
graph is searched. The analysis is tricky because the 
elusive worst case (CS*) moves around in the graph 
for different searches, N. We introduce the notation 
h = L^y^-J + 2, which is used throughout this section. 

Lemma 1 Assume that Algorithm has just completed 
searching level I. Then 

1. If a = I (mod 2) coalitions of size h will have been 
seen paired together with all coalitions of size h — 2 
or smaller. 

2. If a ^ I (mod 2) coalitions of size h will have been 
seen paired together with all coalitions of size h — 1 
and smaller. 

Proof. 

1. At level I the largest coalition in any coalition struc- 
ture has size a — I + 1. Therefore, one of the coali- 
tion structures at level I is of the form Si, S2, ■ ■ ■ , Si 
where \Si\ = 1 for i < I and \Si\ = a — I + 1. Since 
a = I (mod 2), h — + 2. Take coalition Si and re- 
move h agents from it. Call the new coalition formed 
by the h agents S^. We will distribute the remaining 
— 1 agents among the coalitions of size 1. By 
doing this we can enumerate all possible coalitions 
that can appear pairwise with coalition S^ on level 
I. For all j = 1,2,..., 2=i - 1, place 2=i - j agents 

in coalition Si and call the new coalition S{. Redis- 
tribute the remaining j — 1 agents among coalitions 
S2, . . • , Si— 1. For each j we have listed a coalition 
structure containing both S'i and S{ . The largest of 
these S{ has size or h — 2. 



6 If the domain happens to be superadditive, the algo- 
rithm finds the optimal coalition structure immediately. 



2. Since a ^ / (mod 2), h 



a-l-l 



2. Follow the same 



procedure as for the case 1 except that this time there 
are a ~\~ l remaining agents to be redistributed once 



S[ has been formed. Therefore, when we redistribute 
all these agents among the coalitions Si, . . . Si-i, we 
get all coalitions that were found in part 1 , along with 
coalitions of size h — 1. □ 

From Lemma [l| it follows that after searching level I 
with Algorithm [l], we cannot have seen two coalitions 
of h members together in the same coalition structure. 

Theorem 4 After searching level I with Algorithm [J, 
the bound k(n) is |~^] if a = h — 1 (mod h) and a = 
I (mod 2). Otherwise the bound is |_-r J ■ 

Proof. Case 1. Assume a = I (mod 2) and a = h — 
l(mod h— 1). Let a be an assignment of coalition values 
which give the worst case. For any other assignment 

of coalition values, /3, the inequality k(n) = X? ) > 



Vf^csTj 



V a (CS,) 

holds. Since CS* is the best coalition structure 
under a, we can assume that Vs = for all coalitions 
S (I CS* without decreasing the ratio y° ^(c% j • Also, 
no two coalitions S, S' G CS* can appear together if 
vs + vs' > max{%«} for S <E CS*, since otherwise 
we could decrease the ratio k(n). Therefore V a (CSi) = 
max{us} for S 6 CS* Call this value v* . We can derive 
an equivalent worst case, a', from a as follows: 

1. Find a coalition structure CS' with [_fj coalitions of 
size h and one coalition of size h — 1 . 

2. Define v - v ^ cs " ^ 



LfJ+i ' 

3. Assign a value v' s = v to each coalition in CS'. 

Clearly V a (CS*) = V a ,(CS'). From Lemma|| we know 
that no two coalitions in CS' have been seen together. 
The best value of a coalition structure seen during the 
search is V a < (CSi) — v. Therefore the following inequal- 
ities hold; 

v a ,(cs') = (L^J + i)v = a~J + i)Vc{csi) 
{Y{\ + i)v a .{cs l ) < (L|j + iK < (L^J + i)v a (cst). 

Since V a (CS*) = V a ,(CS') and V a , {CSl ) < V a (CS t ), 



k(n) 



V a (CS*) 
V a (CS{) 



V a ,(CS ) = a = a. 
~ V a , {CSl) l h ]+ l h 



Therefore the bound is [#] . 

Case 2. This is a similar argument as in Case 1, ex- 
cept that the assignment of values to the coalitions in 
the equivalent worst case coalition structure is different. 
Define a as before and let CS + be a coalition structure 
with [^J coalitions of size h and one possible remainder 

coalition of size less than h. Define v — , „ — - and as- 

L h J 

sign value w<t — v if \S\ = h and 5* € CS + , otherwise let 
Vs = for all other coalitions including the remainder 



coalition in CS + . Thus the best coalition seen has value 
V a + (CSi) — vs and we have the following inequalities: 

V a+ (CS + ) = ([^j)v = ([^j)V a+ (CS l ) 

(L|j)v Q+ (cso < (l|jk < (\.l\)v a (cst). 

Therefore the bound k(n) — |_f J- □ 



Theorem 5 The bound in Theorem y| is tight. 

Proof. Case 1: Assume a = I (mod 2) and a 
h I (mod /i). The bound is Assumeyou have 

the coalition structure CS' from Theorem H Assign 
value 1 to each coalition S 6 CS" and assign value 
to all other coalitions. Then V(CS') = \^\. Since ( 
Lemma 0) no two of the coalitions in CS' have ever 
appeared in the same coalition structure, V(CSi) = 1. 

Therefore vies?) = = 1 and thc bound is tight. 
Case 2: Assume a ^ Z(mod 2) or a ^ h— l(mod h). Thc 
bound is |_§ J • Assign value 1 to each coalition S £ CS + 
from Theorem || and assign value to all other coali- 
tions. Then V(CS+) = ff] and V(CS t ) = 1. There- 



fore 



v(cs+) _ Lf J _ 
v(csi) — 1 _ 



[^J and the bound is tight. 



As we have shown in the previous section, before 2 a 
nodes have been searched, no bound can be established, 
and at n = 2 a ~ 1 the bound k = a. The surprising 
fact is that by seeing just one additional node (n = 
2 a ~ 1 + l), i.e. the top node, the bound drops in half (k — 
§). Then, to drop k to about |, two more levels need 
to be searched. Roughly speaking, the divisor in the 
bound increases by one every time two more levels are 
searched. So, the anytime phase (step 2) of Algorithm |l| 
has the desirable feature that the bound drops rapidly 
early on, and there are overall diminishing returns to 
further search, Figure ||[ 



- COALITION-STRUCTURE-SEARCH-1 
Splitting algorithm 



50000 1 00000 

Number ot nodes searched 



Figure 3: Ratio bound k as a function of search size in 
a 10- agent game. 



Comparison to other algorithms 

All previous coaliti on structure generation a lgorithms 
for general CFGs (3hehory & Kraus 1996; Ketchpcl 



1994) — that we know of — fail to establish any worst 
case bound because they search fewer than 2 a ~ 1 coali- 
tion structures. Therefore, we compare our Algorithm [l] 
to two other obvious candidates: 

• Merging algorithm, i.e. breadth first search from 
the top of the coalition structure graph. This al- 
gorithm cannot establish any bound before it has 
searched the entire graph. This is because, to es- 
tablish a bound, the algorithm needs to see every 
coalition, and the grand coalition only occurs in the 
bottom node. Visiting the grand coalition as a spe- 
cial case would not help much since at least part of 
level 2 needs to be searched as well: coalitions of size 
a — 2 only occur there. 

• Splitting algorithm, i.e. breadth first search from 
the bottom of the graph. This is identical to Al- 
gorithm [j] up to the point where 2 a_1 nodes have 
been searched, and a bound k = a has been estab- 
lished. After that, the splitting algorithm reduces 
the bound much slower than Algorithm [l]. This can 
be shown by constructing bad cases for the split- 
ting algorithm: the worst case may be even worse. 
To construct a bad case, set Vs = 1 if \S\ = 1, 
and vs — otherwise. Now, CS* = {{1}, {a}}, 
V{CS*) = a, and V(CS* N ) = 1-1, where I is the level 
that the algorithm has completed (because the num- 
ber of unit coalitions in a CS never exceeds I — 1). So, 
y . \ = jzj >0 Figure [| In other words the divisor 
drops by one every time a level is searched. How- 
ever, the levels that this algorithm searches first have 
many more nodes than the levels that Algorithm |] 
searches first. 

Variants of the problem 

In general, one would want to construct an anytime al- 
gorithm that establishes a lower k for any amount of 
search n, compared to any other anytime algorithm. 
However, such an algorithm might not exist. It is con- 
ceivable that the search which establishes the minimal 
k while searching n' nodes [n 1 > n) does not include 
all nodes of the search which establishes the minimal k 
while searching n nodes. This hypothesis is supported 
by the fact that the curves in Figure ^ cross in the end. 
However, this is not conclusive because Algorithm ^ 
might not be the optimal anytime algorithm, and be- 
cause the bad cases for the splitting algorithm were not 
shown to be worst cases. 

If it turns out that no anytime algorithm is best for all 
n, one could use information (e.g. exact, probabilistic, 
or bounds) about the termination time to construct a 
design-to-time algorithm which establishes the lowest 
possible k for the specified amount of search. 

In this paper we have discussed algorithms that have 
an off-line search control policy, i.e. the nodes to be 



searched have to be selected without using information 
accrued from the search so far. With on-line search 
control, one could perhaps establish a lower k with less 
search because the search can be redirected based on the 
values observed in the nodes so far. With on-line search 
control, it might make a difference whether the search 
observes only values of coalition structures, V(CS), or 
values of individual coalitions, vs, in those structures. 
The latter gives more information. 

None of these variants (anytime vs. design-to-time, 
and off-line vs. on-line search control) would affect our 
results that searching the bottom two levels of the coali- 
tion structure graph is the unique minimal way to es- 
tablish a worst case bound, and that the bound is tight. 
However, the results on searching further might vary in 
these different settings. This is a focus of our future 
research. 

Distributing coalition structure search 
among insincere agents 

This section discusses the distribution of coalition struc- 
ture search across agents (because the search can be 
done more efficiently in parallel, and the agents will 
share the burden of computation) and the methods of 
motivating self-interested agents to actually follow the 
desired search method. Self-interested agents prefer 
greater personal payoffs, so they will search for coalition 
structures that maximize personal payoffs, ignoring k. 
In order to motivate such agents to follow a particular 
search that leads to desirable social outcomes (e.g. a 
search that guarantees a desirable worst case bound k), 
the interaction protocol has to be carefully designed. It 
is also necessary to take into account that an agent's 
preference between CSs depends on the way in which 
V(CS) is distributed among the agents. Classical game 
theoretic C S selection and payoff division methods are 
not viable (unless modified) in our setting since they 
require knowledge of every CS £ M. This is because, 
according to those solution concepts, an agent can jus- 
tifiably claim more than others receive from V(CS) by 
objecting to CS (both to the structure and to the pay- 
off distribution ). A justified objection (as defined clas- 
sically e.g. in ( p^ahan fc Rapoport 1984 )) depends on 
all possible CSs. Thus it uses information beyond the 
region of the search space that any nonexhaustive al- 
gorithm should search. The protocol designer cannot 
prohibit access to information that may support such 
objection because the agents can locally decide what to 
search. However, the protocol designer can forbid ob- 
jections and make additional search unbencficial, as we 
demonstrate below The distributed search consists of 
the following stages: 



7 The only exception comes when the algorithm completes 
the last (top) level, i.e I — a. Then ^Ics* ) ~ ^' 



8 The protocol designer cannot prevent agents from opt- 
ing out, but such agents receive null excess payoffs since 
they do not collude with anyone. That is, for l^l = 1, the 
payoff to the agent is equal to its coalition value vs- This 
assumes that agents do not recollude outside the protocol, 
but such considerations are outside of protocol design. 



1. Deciding what part of the coalition structure 
graph to search: This decision can be made in 
advance (outside the distributed search mechanism), 
or be dictated by a central authority, or by a ran- 
domly chosen agent 9 , or be decided using some form 
of negotiation. The earlier results in this paper give 
prescriptions about which part to search. For exam- 
ple, the agents can decide to use Algorithm [y. 

2. Partitioning the search space among agents: 

Each agent is assigned some part of the coalition 
structure graph to search. The enforcement mech- 
anism, presented later, will motivate the agents to 
search exactly what they are assigned, no matter how 
unfairly the assignment is done. One way of achiev- 
ing ex ante fairness is to randomly allocate the set 
search space portions to the agents. In this way, each 
agent searches equally on an expected value basis, al- 
though ex post, some may search more than others.^ 
The fairest option is to distribute the space so that 
each agent gets an equal share. 

3. Actual search: Each agent searches part of the 
search space. The enforcement mechanism guaran- 
tees that each agent is motivated to search exactly 
the part of the space that was assigned to that agent. 
Each agent, having completed the search, tells the 
others which CS maximized V(CS) in its search 
space. 

4. Enforcement of the protocol: One agent, i, and 
one search space of an agent j, j ^ i, will be selected 
randomly. 9 Agent i will re-search the search space 
of j to verify that j has performed its search as re- 
quired. Agent j gets caught of mis-searching (or mis- 
representing) if i finds a better CS in j's space than 
j reported (or i sees that the CS that j reported does 
not belong to j's space at all). If j gets caught, it has 
to pay a penalty P. To motivate % to conduct this ad- 
ditional search, we make i the claimant of P. There 
is no pure strategy Nash equilibrium in this proto- 
col.]^] If i searches and the penalty is high enough, 
then j is motivated to search sincerely. However, i 
is not motivated to search since it cannot receive P. 
Instead, there will be a mixed strategy equilibrium 
where i and j search truthfully with some probabili- 
ties. By increasing P, the probability that j searches 
can be made arbitrarily close to one. The probabil- 
ity that i searches approaches zero, which minimizes 
enforcement overhead £j 



9 The randomization can be done without a trusted third 
party by using a distributed nonmanipulable protocol fo r 



randomly permuting agents ( Zlotkin fe Rosenschein 1994 ) 
Distribu ted randomization is also discussed in 1 Linial 1992 ) 
10 See ( |Mas-Colell, Whinston, fe Green 1995b for a defini 



5. Additional search: The previous steps of this dis- 
tributed mechanism can be repeated if more time to 
search remains. For example, the agents could first 
do step 1 of Algorithm [l]. Then, they could repeat- 
edly search more and more as time allows, again using 
the distributed method. 

6. Payoff division: Many alternative methods for 
payoff division among agents could be used here. 
The only concern is that the division of V{CS) may 
affect what CS an agent wants to report as a re- 
sult of its search since different CSs may give the 
agent different payoffs (depending on the payoff di- 
vision scheme). However, by making P high enough 
compared to V(CS)s, this consideration can be made 
negligible compared to the risk of getting caught. 

Related research on computational 

coalition formation 

Coalitio n formation has been widely studied in game 
theory (Kahan fe Rapoport 1984 ; Bcrnhcim, Pcleg, & 
Whinston 1987; Aumann 1959| ). They address the ques- 
tion of how to divide V(CS ) among agents so as to 
achieve stability of the payoff configuration. Some also 
address coalition structure generation. However, most 
of that work has not taken into account the computa- 
tional limitations involved. This section reviews some 

of the work that has. 

( Deb, Weber, fe Winter 1996 ) bound the maximal 



tion of Nash equilibrium. 

11 Agent j will try to trade off the cost of search against 
the risk of getting caught, and could decide that the risk is 
worth taking. This problem can be minimized by choosing 
a high enough P. 



number of payoff configurations that must be searched 
to guarantee stability. Unlike our work, they neither 
address a bound on solution quality nor provide meth- 
ods for coalition structure generation. 

(Ketchpel 1994) presents a coalition formation 
method which addresses coalition structure generation 
as well as payoff distribution. These are handled simul- 
taneously. His algorithm uses cubic time in the number 
of agents, but guarantees neither a bound from opti- 
mum nor stability of the coalition structure. There is 
no mechanism for motivating self-interested agents to 
follow his algorithm. 

(Shchory & Kraus 1996) analyze coalition formation 
among self-interested agents with perfect information in 
CFGs. Their protocol guarantees that if agents follow 
it (nothing necessarily motivates them to do so), a cer- 
tain stability criterion (K-stability) is met. Their other 
protocol guarantees a weaker form of stability (polyno- 
mial K-stability), but only requires searching a polyno- 
mial number of coalition structures. Their algorithm is 
an anytime algorithm, but does not guarantee a bound 

fro m optimum. 

( Shchory fe Kraus 1995| ) also present an algorithm 
for coalition structure generation among cooperative 
agents. The complexity of the problem is reduced by 
limiting the number of agents per coalition. The greedy 
algorithm guarantees that the solution is within a loose 
ratio bound from the best solution that is possible given 
the limit on the number of agents. However, this bench- 
mark can, itself, be arbitrarily far from optimum. On 



the other hand, our work computes the bound based on 
the actual optimum. Our result that no algorithm can 
establish a bound while searching less than 2 a_1 nodes 
does not apply to their setting because they are not 
solving general CFGs. Instead, they address a more 
specialized setting where the vs values have special 
structure. In such settings it may be possible to estab- 
lish a worst case bound with less search than in general 
CFGs. 



( Sandholm & Lesser 1997) study coalition forma- 
tion wrth~^^o^u¥^iiTnc~o^tImization activity: how do 
computational limitations affect which coalition struc- 
ture should form, and whether that structure is sta- 
ble? That work used a normative model of bounded ra- 
tionality based on the agents' algorithms' performance 
profiles and the unit cost of computation. All coali- 
tion structures were enumerated because the number 
of agents was relatively small, but it was not assumed 
that they could be evaluated exactly because the opti- 
mization problems could not be solved exactly due to 
intr actability. The methods of this paper can be com- 



bincd with their work if the performance profiles are 
deterministic. In such cases, the v$ values represent 
the value of each coalition, given that that coalition 
would strike the optimal tradeoff between quality of 
the optimization solution and the cost of that computa- 
tion. Our algorithm can be used to search for a coalition 
structure, and only afterwards would the coalitions in 
the chosen coalition structure actually attack their opti- 
mization problems. If the performance profiles include 
uncertainty, this separation of coalition structure gen- 
eration and optimization does not work e.g. because 
an agent may want to redecide its membership if its 
original coalition receives a worse optimization solution 
than expected. 

Conclusions and future research 

Coalition formation is a key topic in multiagent sys- 
tems. One would prefer a coalition structure that max- 
imizes the sum of the values of the coalitions, but often 
the number of coalition structures is too large to allow 
exhaustive search for the optimal one. This paper fo- 
cused on establishing a worst case bound on the quality 
of the coalition structure while only searching a small 
portion of the coalition structures. 

We showed that none of the prior coalition struc- 
ture generation algorithms for general CFGs can estab- 
lish any bound because they search fewer nodes than 
a threshold that we showed necessary for establishing 
a bound. We presented an algorithm that establishes 
a tight bound within this minimal amount of search, 
and showed that any other algorithm would have to 
search strictly more. The fraction of nodes needed to 
be searched approaches zero as the number of agents 
grows. 

If additional time remains, our anytime algorithm 
searches further, and establishes a progressively lower 
tight bound. Surprisingly, just searching one more node 



drops the bound in half. As desired, our algorithm low- 
ers the bound rapidly early on, and exhibits diminish- 
ing returns to computation. It also drastically outper- 
forms its obvious contenders: the merging algorithm 
and the splitting algorithm. Finally, we showed how to 
distribute the desired search across self-interested ma- 
nipulative agents. 

Our results can also be used as prescriptions for 
designing negotiation protocols for coalition structure 
generation. The agents should not start with every- 
one operating separately — as one would do intuitively. 
Instead, they should start from the grand coalition, 
and consider different ways of splitting off exactly one 
coalition. After that, they should try everyone operat- 
ing separately, and continue from there by considering 
mergers of two coalitions at a time. 

Future research includes studying design-to-time al- 
gorithms and on-line search control policies for coalition 
structure generation. We are also analyzing the inter- 
play of dynamic coalition formati on and belief revision 



amon g bounded-rational agents (Tohmc & Sandholm 



1997). The long term goal is to construct normative 
methods that reduce the complexity — in the number of 
agents and in the size of each coalition's optimization 
problem — for coalition structure generation, optimiza- 
tion and payoff division. 
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